Definition. Orthogonality {u, v) —0 ^ u±v. 

Definition. {(pi}i^j, I countable is orthonormal if = 1, and {ipi,ipj) =0,i = j. 

Example. Basis vectors in C^. 

Definition. Fourier Coefficients if / e if the (discrete) Fourier Coefficients of / are 

Cn(/) = (/, v^n) e C, ne I 
Assume 7 = {1, . . . } is enumerated. Consider 

N 



n=l 



Theorem. Bessel's Inequality If {ipi\i^i is an orthonormal set and f E H a Hilbert 
space, then 



j2\<^n{f)\'<\\fr<oo 



n=l 



/ 



Proof. Sn = E^Ii Cj(/)<^i, = {f,ipi). Recall that 

f,geH, f±g ^ 11/ + gf = {f + gj + g) = (/, /) + (/, g) + {g, f) + (5, g) 
Apply this repeatedly so 



+ 11^1 



N-l 



Ci{f)<Pi + CN{f)(pN 



1=1 



N 



N 



1=1 
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Consider f - SN(f)±'Pi, l<i< N. Then 

So (/-5jv(/),M/))=0then 

= ll^iv(/)ir - E ^ 11/11'' because ||/ - > 

i=l 



□ 



liM> N then 



||^iv(/)-^M(/)|P 



n=N 



M 



n=Ar 



SO it follows that S^if) is Cauchy in if. Then the completeness of H implies that 5'iv(/) 
S{f) converges in H. Does S{f) — f always? We have a condition below to answer this. 

Definition. In H {ipi}i^i, I countable is said to be complete if, w G if and {w,ipi) = 

0, Vi e 7 then w = 0. 

Proposition. Completeness of tpi is equivalent to the condition 

/ = E ^Mfn, V/ e H,Cn^ (/, (fin) 

1. e. / = limjv-.oo'S'Ar(/) ^ S{f). 

Proof. Look at / — S{f). Then / — S'7v(/)±<^„, yN > n. We know by Cauchy-ness that 
^Nif) — 'S'(/) for some S{f). Now we have to show that 

0={f-S^{f),ip^)^{f-S{f),ip^) 

we must simply show that (5'jv(/), — > {S{f),(pn). But if gj g m. H then e 
{gj,w) {g,w) since 

\{9-9j,w)\ < \\g - gj\\\\w\\ ^0. 
So by (/ — S{f), ifin) = for all n, so by completeness, / — S{f) = and / = S{f). □ 

Our main example of complete orthonormal function are the fourier series. Fourier series, 
functions on [— tt, tt] G M. We claim that 



exp{inx), n e Z 
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is a complete orthonormal set in L^([— tt, tt], /iLeb)- We know that 



-7r,7r] ^"^ 



Also, 



assume n m, then the above is 

d^^i(n-m)x -i i{n-m)x -j^ 
'^^ -dx=^-, r =0 



27rj[_^,^] i{n-m) 27ri{n- 



m) 



but there is a problem: these are Riemann integrals. We have only proved the FTC applies 
to Riemann integrals. We would like 

Theorem. If f is continuous on [a, h] then 

Riemann Integral — I fdx — / fdjiLeb — Lehesgue Integral 

J a J[a,b] 

This theorem would imply that {^^^^^^}n is orthonormal in L^([— tt, tt]). However, it is 
hard to prove that arc complete. 

Theorem. Separable Hilbert space has a complete orthonormal set (called a basis) 

Proof. H is separable if it has a countable dense subset E C H,E — H. We prove it has a 
basis by using Gram-Schmidt process. Order the set E — {ei, 62, . . . }. We have the following 
two steps 

1. ei if ei = 0, then go to step 2. If ei 7^ then 

ei 

^1 



ei 



2. Assume after n steps that wc have {ipi, . . . , ipn} orthonormal and Cj G span^jf^i, . . . , ipn}, j < 
n. Then consider e„+i. If e„+i G span^lv^i, . . . , ^n} pass to next step. 

If e„+i ^ spanc{93i, • • • , V'n} then 



N 



9 = en+i - ^(e„+i, ipi)ipi 7^ 



i=l 



(because if e„+i can be written as such a sum then e„+i is in the span). Now 9-i-ipi, 1 < 
i <n, and define 

9 

Vn+l = TTIT 

m 
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if we continue this indefinitely, then we get {<fi}{i^i} orthonormal. 

Show completeness: Suppose w ^ H, u'_L(/?i,Vi. The density of E in H implies 
that given e > 0, 3ei E E such that \\w — e/|| < e. But e/ is a finite linear combination 
ei = E/miteCi<^i- So w±ei, and 

^ II 11^ II 11^ I II llx » II II J- 

since this holds Ve, ||-u;|| =0. □ 

Now lets go back and prove that the Riemann integral is the same as the Lebesgue 
integral (in the cases we care about) 

Theorem. If f e C{[a,b]) then f e C^{[a,b]) and 



/ f{x)dx= I fd/iL 

J a J \a,b] 



a,b] 

is true if f is Riemann integrable 

Proof, f Riemann integrable means that / is bounded and 

sup L{f, P) = ffdx = ffdx = inf [/(/, P) 

P Ja_ Ja ^ 

where L(/, P) and [/(/, P) are the familiar upper and lower sums. Then set 

Sl{P) = JX[ai,a,) 
(a— l,ajj 

a simple measurable function. Just to make sure everything is kosher, replace / by / + c > 0, 
so that we know we are working with positive functions. Then 



L{f,P)^I{sL{P))< I fduL^ ffdx< f fdUL 

J\a,b] J a J\aM 



rb 

J 

;,6] J a J [a,6] 

We can prove the inequality the other way by considering (— / + c) □ 



So now we have justified the computation of {ipn, Vm) where ipn = 
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